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ABSTRACT 

This study investigated whether the visual forms of buttons influenced learning and satisfaction 
when early adolescent students were asked to perform tasks using computer-assisted instruction 
(CAI). Ninety subjects participated. Three visual forms were designed for buttons located in a 
CAI application. One contained pictures for commands, the second contained words for 
commands, and the tliird containe<l the combination of pictures aiid words. Each subject was 
assigned to one of six groups. Each group used two of the three styles of buttons. The groups 
pcrfonned two sets of three tasks. Response time, accuracy, and satisfaction were measured. 

'Hie results indicated timt groups pcrfonned faster witii tlie second task set. The results also 
indicated that groups were more accurate in their responses when the buttons illustrated words than 
when liic buttons illustrated tlie combination. Results for satisfacdon indicated tliat groups were 
more satisfied with tlie combination than they were witli die words. 



INTRODUCTION 

SluclLMits who use CAI will not tolerate a poorly designed interface tliat is not intuitive at first 
sight. Since students infrequently use the same CAI application they are less motivated to leain 
its use. Shneiderman (1987) stated that if the students do not understand die CAI application at 
fii:st sigiu the students will likely abandon the use of the computer or try a competing package. 
1 lence, the CAI application's interface must meet their needs. Learning users should be able to 
point and click with the mouse at commands illustrated on the computer screen. See-and-point 
inicrfaccs usually contain buttons illustrated as pictures, as words, or as die combination of 
pictures and words (Apple Computer, Ire, 1987). For adult learners of computer applications it 
lias been found that performance and sa isfacUon are affected by die visual fonn in which tlie 
commands ai*e illustrated. In fact, studi is have found diat pictures (Temple, Barker, & Sloane, 
1990), and die combination of pictures and words (Egido & Patterson, 1988) are preferred to words 
by adult learning users. 

Research on cognitive development seems to support the notion diat pictures and die combinations 
arc preferable for adults when adults are required to understand diem as representaUons of 
information. According to Bruner et al. (1966), die development of die representations of 
information in ilie mind is identifiable during die early stages of life. By adolescence dirougli 
acliiltho(xI die number of menial representations increases depending on experience and matuiity and 
may include visual images and words diat denote a single idea. Viewing a picture or die 
conibiiiadon of a picture and a word helps adults understand and discriminate ideas diat are 
represented by diem. 

One of the questions diat arises is if early adolescents will perfonn as well as and be as saUsfied as 
adulls when using CAI diat includes pictures and die combinadon of pictures and words for 
buttons. Do early adolescents have die aptitude to understand picture labels as well as word labels? 
Finally, does die combinadon of pictures and words used to illustrate commands on die screen tax 
the early adolescent's memory load? In order to answer diese quesdons the following study was 
conducted. The purpose of die study was to detennine die effect of the diree styles of buttons 
(pictures, words or die combinadon of pictures and words) on ease of learning and computer 
iiiteracUon satisfaction when early adolescent school students were required to use a CAI 
applicadon. 
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METHOD 

Ninety (44 males and 46 females) early adolescent school students pardcipated in the study. Each 
student was randomly assigned to a group. The groups saw two of the three styles of buttons: 
picture, words, or tlie combination of pictures and words. Group A used pictures first and words 
second, while group B used words fu'st and pictures second. Group C used the combination of 
pictures and words first and words second, while group D used pictures first and the combination of 
pictures and words second. Group E used words first and the combination of pictures and words 
second, while group F used the combination of pictures and words first and words second. Tlie 
tests were administered dming and after school. The study took approximately forty to fifty 
minutes to complete. 

The CAI application contained a collecdon of facts on history. The students were able to search 
through subject areas contained in the applicadon easily by poindng and clicking with a mouse on 
tlie buttons located at tiie bottom of die computer screens. The picture labels for the buttons were 
black and white and die words were displayed in Times Roman at 10 points. Tlie buttons were 
approximaiely 1/2" square. 

The CAI application was a commercially available package diat was modified for experimentation. 
It originally had picture labels for die buttons. These labels were revised to words and a 
combination of pictures and words based on die description of die function of the buttons found in 
a Help section of die CAI applicadon. 

Each group perfonned a set of tasks (i.e., a set of diree tasks) while using one of die two styles of 
buttons assigned. One task at a time appeared on die computer screen when die subjects in the 
groups selected a button labeled Show Task . After completing die set of tasks, die computer 
prompted the subjects to complete a sadsfacdon quesdonnaire. After completing die questionnjiirc 
the subjects viewed die second set of buttons and performed die second set of tasks. After 
completing Uie second set of tasks, sadsfacdon was assessed again. 

Each of the tasks required die same amount of mouse modon on die saeen and required die same 
amount of branching dirough die applicadon. The computer recorded die subject's ID number, tiie 
buttons selected, diink dme which was die elapsed dme between button selections, task time 
which was Uie total elapsed time on task, and total task time which was die total elapsed time on 
die set of tasks. The computer process dme, which was die computer's time to perform die 
operation required when a button was selected was recorded independendy. 

The button selecdons were idendfied and a radng of response accuracy was recorded for cacii set of 
tasks. The scores could range from 0 to 3 (0 = no correct responses, 3 = all correct responses). 

The students had access to each task while searching for die answer. The tasks were displayed on 
the computer screen when die button labeled Show Task was selected. The dme spent reading die 
task wjis not included in die subjects' performance scores. 

A user interaction sadsfaction questionnaire was used to measure sadsfacdon. Posidve satisfaction 
was indicated by iiigh scores. ITie quesdonnaire contained 13 items widi 9 point scales. Possible 
scores ranged from 0 to 117. 

DESIGN 

Tlie dependent variables response dme, response accuracy, and sadsfacdon were recorded and 
analyzed in Uiree two-by-two Ladn squares widi repeated measures designs. Tlie Latin square with 
repeated me^isures design was selected because it allowed die researcher to economize on subject 
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numbers and it allowed the researcher to collect data on a number of variables while exposing tliem 
to more than one treatment. See Figure 1 for an illustration of the design. 



Group 
A 
B 

C 
D 

E 
F 



Task Set 1 


Task Set 2 


X1O1O2O3 


X2O1O2O3 


X2O1O2O3 


X1O1O2O3 


X3O1O2O3 


X1O1O2O3 


X1O1O2O3 


X3O1O2O3 


X2O1O2O3 


X3O1O2O3 


X3O1O2O3 


X2O1O2O3 



Mea^iireniems Treatments Conditions 

0 1 = Time X i = Picture Interface Type Task Set 1 

02 = Number correct X2 = Word Interface Type Task Set 2 

03 = Satisfaction X3 = Picture and Word Interface Type 
Figure 1 . Diagram of experimental design 



RESULTS 

DESCRIPTION OF THE STUDY 

The study was conducted over the course of a month and a half. Initially, the researcher tried 
conducting llie study after school so that there would not be a conflict with the other studies in 
which the subjects might be involved. However, it was found after several days of testing tliat 
many subjects were not willing to participate after school. Some students had other activities to 
attend, and others lost interest. Due to poor attendance, the researcher tested the remaining subjects 
during school. 

Testing ilie subjects during school resulted in other problems. The computer laboratory at the 
school was frequently used by classes. The researcher found that there was little time between 
chisses to collect the data from the computers before another class wanted to use them. In addition, 
dming tlie time when tlie computer laboratory was not scheduled for use, teachers and students 
came to tlie laboratory to work independently on assigned tasks. 

During tlie testing periods, the procedures were explained to the subjects and the CAI application 
was demonstrated. When the subjects were told to start, many seemed confused as to what to do. 
Some asked their peers what they were to do. The researcher helped many subjects get started. 
After Uiese initial delays, llie subjects appeared to have little difficulty in understanding what was 
expected of them. 'Ilie rcseju*cher accounted for these initial delays during tlie data analyses. 
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ANALYSES 

Latin square with repeated measures design analyses were performed to determine whether there 
were significant mean differences in the groups, tasks, and interfaces on tlie dependent variables: 
response time, response accuracy, and satisfaction. The groups and tasks were evaluated as 
independent variables. 

Response Time 

The results from the analysis of each independent variable for response time indicated that tliere 
were significant differences in the two sets of tasks. All groups performed significantly faster 
when using the second set of tasks. Table 1 and Table 2 display the results. 



Table 1. 

Analysis of Perfoi-mance hy Task for Response Time 



Source ctf M& Error F p 



Grps A & B 
(T.'isk Unit) 


171396421.350 


1 


171396421.350 


Em)r 


5.491 


<.05 


Grps C & D 
(Task Unit) 


369614476.017 


1 


369614476.017 


Error 


14.649 


<.05 


Grps E & F 
(Task Unit) 


247786146.017 


1 


247786146.017 


Error 


9.701 


<.0b 



Note: Response time was measured in ticks. There are approximately 60.15 ticks per second in 
HypciCard (Apple Computer, 1989). 



Table 2. 

Analysis of Mean Scores by Task for Response Time 





Task Unit 1 




Task Unit 2 


Source 


M 1 


SD 


M SD 


Grps A & B 


13175.73 


7921.23 


9795.43 6002.28 


Gips C & D 


13508.67 


7230.07 


8544.70 4056.48 


Grps_E & F 


12235.60 


8382.43 


8171.23 4573.16 



Note : The number of subjects in each group = 15. Response time was measured in ticks. 



Response Accuracy 

There was a significant mean difference in response accuracy for two of the styles of buttons 
between groups E (word / picture & word) and F (picture & word / word). Table 3 and Table 4 
display tlie results from liie analyses. 
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Table 3. 

Analysis of Performance by Interface for Accuracy of Response 



Source df MS Error FjMQ 12 



dps A&B 
(Interface) 


.017 


1 


.017 


Error 


.041 


n.s. 


Grps C&D 
(Interface) 


.017 


1 


.017 


Enw 


.039 


n.s. 


Grps E & F 
(Interface) 


3.267 


1 


3.267 


EiTor 


5.834 


<.05 



Note : Overall ratings for accuracy of response could range froni 0 to 3 (0 = no correct responses, 3 
= all correct responses). 



Table 4. 

Analysis of Mean Scores bv Interface for Accuracy of Response 





Pictures 




1 Words 




Pictures & Words 


Source 


M 


3D. 


1 M 


SD 


M 


SD. 


Grps 
A&B 


1.30 


.85 


1.27 


.83 






Gips 
C&D 


1.47 


.78 






1.43 


.68 


Grps 
E &F 






1.50 


.90 


1.03 


.62 



Noic: The number of subjects in each group =15. Overall ratings for accuracy of response could 
range from 0 to 3 (0 = no correct responses, 3 = all correct responses). 



Satisfaction 



There was a significant mean difference in satisfaction for twi jf the visual forms between groups 
E (word / picture & word) and F (picture & word / word). Table 5 and Table 6 display Uie results 
from tlie analyses. 
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Table 5. 

Analysis of Performance by Interface for Interaction Satisfaction 



Source 






Si 


MS 






Grps A&B 
(Interface) 




1.067 


1 


1.067 


EiTor 


.015 n.s. 


Grps C & D 
(Inierface) 




1.667 


1 


1.667 


Error 


.061 n.s. 


Grps E&F 
(Interface) 




576.60 


1 


576.60 


Error 


4.710 <.05 


Note: Computer interaction satisfaction scores could range frcm 0 to 1 17. Positive computer 
interaction was indicated by high scores. 


Table 6. 

Analysis of Mean Scores bv Inierface for Interaction Satisfaction 






1 




Pictures I 




Words 


Pictures & Words 


Souice 


M 




M 




M 


SD 


Grps 
A&B 


75.83 


16.03 


76.10 


15.03 






Grps 
C&D 


81.30 


15.55 






81.63 


15.92 


Grps 
E&F 






76.53 


17.39 


82.73 


15.77 



Note : The number of subjects in each group = 15. Computer interaction satisfacdon scores could 
range from 0 to 117. Positive computer interaction was indicated by high scores. 



DISCUSSION 

The styles of buttons used for the conunands in see-and-point interfaces can influence a learner's 
ability to use CAI. llic goal is to select the appropriate type. The learner dealing witli new 
information should be able to easily navigate through a CAI lesson. Understanding the most 
appropriate way to display the commands becomes increasing important as students are required to 
use technology to leani. Some might argue that the type of button used for a command depends 
on what concept is being represented. Sometimes it might be easier to use a word to illustrate a 
commanrf, in oUier cases it might be easier to use a picture. However, when faced witli designing 
the interface it is important to understand what type of button, in general, works best for a 
particular group of learners. Thus, the present study provides some tentative conclusions lliat cmi 
help guide learner interface design. 

Tlie results from tiie present study indicated that Uie early adolescent school students in groups E 
(word / picture & word) and F (picture & word / word) were more accurate in responding to tlie 
computer interface tiiat included words only compared to the interface that included the combination 
of pictures and words. Perhaps, computer interfaces that incorporate words a;e easier to identify 
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because words tend to be less ambiguous for early adolescent school students. For example, for a 
concept such as "prim an image to the printer" the word Edui might be more explicit. A picture 
of this concept might be difficult to represent especially in a small space on the computer screen. 

Another possibility is Uiat the combination of pictures and words provided too much infonnaiion 
compared to words. The computer screen may have appeared overwhehning in a testing situation. 
Tlie subjects .may not have been able to focus on each button in order to infer a meaning from it. 
According to Galitz (1989), the degree to which a user's memory is being used to understand tJie 
information can have a significant impact on their comprehension of the information. If (he 
amount of information is too much the user's performance will be negatively influenced. 

It is iniercsdng to note that the groups who used Uie words and the combination of pictures and 
words were more sadsfied with the combination even though they didn't perform as accurately wilii 
the combination. This finding illustrates Uiat user satisfaction is not necessarily a good predictor 
of user pcrfonnaiice. According to Long, Hammond, Barnard, Morton, Clark, (1983), the opinions 
of users do not predict how well users will perform. 

All groups were faster the second tijne wiUi Uie second set of tasks. Possibly, as students 
developed an understanding as to how to navigate through the program Uie speed wiUi which tiiey 
pcrfonned increased. However, ilie accuracy in their performance was not affected. It is possible 
that the subjects felt pressured to finish the second set of tasks quickly but not necessarily more 
accurately because otlier subjects had finished. The researcher instructed subjects who were finished 
to quietly leave the computer laboratory or do another activity. However, it was difficult to keep 
the students quiet after finishing the tests. Tlie otlier subjects who were still working were 
probably distracted by this commotion and felt a need to quickly finish. 

An iinportxHit issue is whether the results obtained in die present study can be generalized. The 
CAI application used in the present study represented a geneml layout which is seen in oilier CAI 
applications. The buttons appeared in black and white on the bottom portion of tlie scTcens. 
However, die results might be specific because only a small sampling of representations for 
commmidr were evaluated. 

"Which style button sliould CAI use?" This question remams unanswered. However, die present 
study provides some tentative conclusions to guide learner interface design. The study found 
differences Ixitvvecn the words and the combinaUon of pictures and words when early adolescents 
were required to perform search tasks using CAI. In addiUon, it was found diat satisfaction with an 
interface docs not necessarily indicate how well an early adolescent school student will accurately 
pcrfonned search tasks when using CAI. From diese findings it api")ears tliat there is a difference 
between words and die combinaUon of pictures and words. However, further research needs to be 
done in order to substantiate the significance of these findings. 
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